An optimal solution is a solution that maximises some objective function. Some algorithms, such as hill-climbing, explicitly seek to maximise an objective, while others, such as back propogation effectively do so when examined in detail. Often it is also necessary to satisfy some constraints, so that we look for the optimal solution within the set of feasible solutions.